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Abstract 


— J  Section  1  of  this  paper  reviews  some  works  related  to  reliability 

evaluation  of  nonrenewable  systems.  The  assumption  that  element  failure 

rates  are  lpw  allows  to  obtain  an  expression  for  the  main  term  in  the 

asymptotic  representation  of  system  reliability  function.  Section  2  is 

devoted  to  renewable  systems.  The  main  index  of  interest  in  reliability 

is  the  time  to  the  first  system  failure.  A  typical  situation  in 

reliability  is  that  the  repair  time  is  much  smaller  than  the  element 
9""  9^ 

lifetime.  This  ''fast  repair^property  leads  to  an  interesting  phenomenon 

that  for  many  renewable  systems  the  time  to  system  failure  converges  in  probablity, 

under  appropriate  norming.to  exponential  distribution  .Some  basic 

theorems  explaining  this  fact  are  presented  and  a  series  of  typical 

examples  is  considered.  Special  attention  is  paid  to  reviewing  the  works 

describing  the  exponentiality phenomenon  in  the  birth-and-death  processes. 

Some  important  aspects  of  computing  the  normalizing  constants  are  considered, 
among  then,  the  role  played  by  so-called  eventT<?i”"section  2  contains 

also  a  review  on  various  bounds  on  the  deviation  from  exponentiality. 

Sections  3  ,  4  describe  some  additional  aspects  of  asymptotics  in 
reliability.  It  is  typical  for  the  probabilistic  models  considered  in 
these  sections,  that  a  small  parameter  is  introduced  in  an  explicit  form 
into  the  characteristic  of  the  random  processes. 

A  considerable  part  of  this  review  is  based  on  the  sources  which  were 
originally  published  in  Russian  and  are  available  in  the  English  translation. 

Key  words:  Reliability;  exponentiality;  fast  repair;  small  parameter; 
main  event;  renewable  systems;  asymptotics. 
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*  0.  Introduction 

The  ultimate  goal  of  reliability  theory  is.  to  give  a  numerical  estimate 
of  reliability  indices.  It  is  well  known  that  for  all  more  or  less 
complicated  cases  an  exact  reliability  evaluation  is  practically  impossible. 
This  stimulates  interest  to  approximate  methods  in  reliability  calculations. 

In  many  reliability  models  of  great  practical  interest  "small  parameters" 
usually  are  present,  e.g.,  a  system  under  investigation  has  low  element 
failure  rates  and/or  the  element  failure  rates  are  much  smaller  than  their 
repair  rate.  This  circumstance  makes  it  possible  to  use  efficient  and 
powerful  asymptotic  methods  for  reliability  computation. 

The  goal  of  this  paper  is  to  review  a  collection  of  works  devoted 
to  asymptotic  reliability  analysis.  Most  of  these  works  were  published  in 
English  translations  of  Russian  scientific  journals  and  for  some  reason 
are  not  very  familiar  to  the  Western  applied  probability  community. 

The  contents  of  this  paper  follows. 

A  short  Section  1  is  devoted  to  an  asymptotic  analysis  of  coherent 
systems  without  renewal.  Reliability  analysis  for  these  systems  uses 
the  fact  that  element  failure  rates,  X^,  are  small  in  highly  reliable 
systems  (foimally,  X^  *  X^e,  0  -*•  0),  and  this  makes  it  possible  to 
compute  the  main  term  of  the  asymptotic  expression  for  R(t),  the 
probability  of  failure  free  operation  during  time  t. 

Section  2  which  is  the  central  in  this  paper  deals  with  renewable 
systems.  The  reliability  index  of  greatest  interest  for  these  systems  is 
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*  the  probability  of  failure-free  operation  during  a  given  mission  time  t. 

The  asymptotic  analysis  exploits  the  basic  fact  that  the  average  repair 
time  for  a  failed  element  is  usually  many  times  smaller  than  the  average 
failure-free  operation  time  for  the  same  element.  (This  is  termed  in 
reliability  as  'fast"  or  "rapid"  repair).  A  very  general  scheme  in 
asymptotical  analysis  is  the  following. 

System  functioning  is  described  by  a  regenerating  random  process 
ic(t),  k  (t)  often  being  the  number  of  failed  elements  at  time  t. 

The  regeneration  period  of  ie(t),  £  *  £'  +  c",  where  £'  corresponds 
to  <(t)  *  0  and  g"  to  ic(t)  >  0.  Rapid  repair  results  in  a  small 
probability  q  of  having  system  failure  on  a  single  ^"-interval. 

The  time  t  to  system  failure  (SF),  t  »  +  ...«■  £N,  where  N  is 

a  geometrically  distributed  random  variable  (generally,  N  depends  on  £). 

It  is  not  surprising  that  by  means  of  an  appropriate  norming  constant 

y,  y-t  should  converge  in  distribution  to  an’  exponential  distribution  function. 

Sections  2.1,  2.2  and  2.3  consider  various  aspects  of  this  fact  and 

related  facts.  Section  2.4  gives  a  review  of  a  series  of  important 

applications  to  various  reliability  problems.  Computation  of  the 

quantities  determining  the  normalizing  factor  y  is  a  difficult 

analytic  problem.  We  review  briefly  several  important  works  on  this 

topic,  mainly  due  A.D.  Solovyev,  to  give  an  idea  about  some  technical 

aspects  of  these  computations. 

Many  of  the  reliability  models  of  renewable  systems  can  be  formulated 
in  terms  of  queueing  theory.  The  difference  is  that  the  asymptotic 
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analysis  in  reliability  deals  with  low  traffic »  while  the  classical 
queueing  asymptotic  deals  with  high  traffic.  A  few  works  about  low 
traffic  for  queueing  models  will  be  reviewed  in  section  2.5. 

Birth -and -Death  processes  are  perhaps  the  most  popular  and  useful 
in  reliability  theory.  Section  2.6  is  devoted  to  a  brief  review  of 
the  main  features  of  the  asymptotic  analysis  for  these  processes.  Here 
the  failure-free  operation  time  is  interpreted  as  a  passage  time  Tq^ 
from  an  initial  state  0  to  a  "high"-level  state  m  representing 
SF.  The  works  by  A.D.  Solovyev  and  J.  Keilson  contain  a  rather  complete 
investigation  of  asymptotic  properties  of  tgm  and  related  variables. 

Section  2.7  describes  some  general  features  of  exponential  approximation. 
One  of  them  is  that  the  main  term  in  the  asymptotic  expansion  of  the 
normalizing  factor  has  a  transparent  and  simple  probabilistic  meaning 
and  corresponds  to  so-called  "main  event".  For  example,  it  might  be 
the  event  that  no  repair  of  any  failed  element  was  completed  before  SF 
took  place. 

Section  2.8  surveys  several  works  on  estimating  the  error  bounds 
for  the  exponential  approximation. 

Section  3  gives  very  briefly  an  idea  about  a  method  developed  by 
I.N.  Kovalenko  for  a  special  analysis  of  a  multidimensional  Markov-type 
process  which  has  one  slowly  varying  component  and  one  rapidly  varying 
component.  It  turns  out  that,  under  certain  assumptions,  the  slowly 
varying  component  behaves  like  a  continuos  time 

Markov  process.  Section  4  describes  a  method  of  asymptotic  analysis 
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based  on  a  combination  of  analytical  and  simulation  methods,  which  is 
applicable  when  the  quantities  determining  the  original  process  are 
expressed  in  a  series  form  involving  a  small  parameter. 

We  did  not  survey  a  large  number  of  works  devoted  to  the 
investigation  of  reliability  indices  for  large  t  (t  -*•  •),  e.g., 
stationary  probabilities  of  being  in  a  certain  state,  etc.  In  addition, 
all  works  dealing  with  asymptotic  properties  of  input  flows,  e.g.,  flow 
thinning,  superposition  of  flows,  etc.,  were  left  outside  the  scope  of 
this  review. 


Our  goal  was  not  to  present  an  exhaustive  list  of  bibliography  on 
the  topics  concerned  in  this  survey.  First,  we  avoided  mentioning  those 
works  which  are  not  available  in  English.  Second,  we  did  not  mention 
papers  or  books  which  already  were  cited  in  the  reviewed  sources.  The 
reader  can  easily  trace  them  from  the  cited: works,  if  he  becomes 
interested  in  the  topics  discussed  in  this  review. 


This  review  is  addressed  mainly  to  those  readers  who  prefer  to  get 
a  first  acquaintance  with  a  new  topic  on  an  intuitive  level,  without 
going  into  too  may  technical  details.  The  reader  who  is  interested  in 
proofs  and  other  formal  details  will  be  able  to  learn  them  from  the 
reviewed  sources. 
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Notation  and  Abbreviations 

We  shall  use  the  following  notation  and  abbreviations. 

/ 

r.v.  -  random  variable 

p.d.f.  -  probability  density  function 

d.f.  -  (cumulative)  distribution  function 

BD -process  -  Birth- and -Death  process 

SMP  -  Semi -Markov  process 

SF  -  system  failure 

CM  -  complete  monotone  (family  of  distributions) 

5  ~  F(x)  -  r..v.  5  is  distributed  according  to  the  d.f.  F(x). 
f  ~  Exp (X)  -  r.v.  £  has  an  exponential  distribution  with  parameter  X . 

a  ~  b  -  a  and  b  are  asymptotically  equal,  i.e.,  a/b  •*-  1 
E[(]  -  expectation  of  r.v.  c. 

F(x)  =1  -  F(x) 

x_  *  (x^^.Xj,. . .  ,xn)  -  a  row  vector;  x<£  ,i«l,...,n,  but  for  some  j,x^<y^. 

t  -  time  to  system  failure. 

R(t)  »  P(t  >  t}  -  system  reliability. 

\,X^  -  failure  rates  and/or  transition  rates  for  a  Markov  process. 

E+,  E_  -  sets  of  "good",  resp.  "bad"  states  of  a  system. 

v(t),  x(t),  x(t)  -  random  processes. 

P  *  llp^jli  -  transition  matrix  for  a  Markov  chain. 

-  stationary  probabilities  for  a  Markov  chain. 

F  (x),  H(x),  G  (x)  -  d.f.  's. 

Tq^  -  passage  time  from  state  0  to  state  m  in  a  random  process. 

-  the  expectation  of  TQm 

#  -  end  of  proof  or  end  of  the  formulation  of  a  theorem. 

|b|  -  the  number  of  elements  in  the  set  B. 

1  -  (1,1, ... ,1) '  - 


a  unit  column  vector. 
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1.  Systems  Without  Renewal 

Consider  an  arbitrary  coherent  system  consisting  of  n  independent 
components  (elements),  the  lifetime  of  i**1  element  being  an  exponential 
r.v.  with  failure  rate  X^.  Let  the  state  of  the  system  be  described 
by  a  binary  function  <p(x),  where  x  -  (x^.Xj, . . . ,xn) ,  Xj^  is  a  binary 
indicator  of  the  state  of  it*1  element  (see  Barlow  $  Proschan,  1975, 

Ch.  1,2,4).  Let  t  be  the  system  lifetime  and  let  t  be  the  mission 
time.  Denote  for  any  x,  A(x)  *  (j:Xj*l>,  B(x)  ■  {j:x^*0}.  Then 

-X.t  -X.t 

p(«t>  «  F(t)  »  r  n  e  3  n  (i-e  3  )  .  (i. 

{x:tp(x)»0}  j€A(x)  j6B(x) 

An  asymptotic  investigation  of  this  formula  for  low  failure  rates 
was  done  by  Burtin  5  Pittel,  1972.  A  small  parameter  9  is  introduced 
by  representing  X.  ■  X.0  and  setting  9  -►  0.  Denote  by  A(t|0) 
system  failure  rate,  A(t}9)  *  (dF(t)/dt)/R(t)  and  by  r  the  size  of 
minimal  cut -set:  r  ■  min(|B(x)|  :  <p(x)  ■  0).  The  following  theorem  was 
proved  in  the  abovecited  paper. 

Theorem  (Burtin  5  Pittel.  1972).  As  9  -►  0 

A(t|e)  -  r9r  tr_1  I  n  X.  (1+0(1))  (1.2) 

{x:«5(x)«0  §  |B(x)|-r)  j€B(x)  J 

uniformly  with  respect  to  an  arbitrary  interval  0<6$t<d<®.  # 

The  main  term  in  (1.2)  corresponds  to  the  Weibull  distribution. 

To  explain  this  surprising  fact,  let  us  substitute  Xj  ■  ^0  into  (1.1) 
and  expand  exp(-X^t)  ■  1  -  X^9t  +  o(9).  The  main  term  in  the 
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expansion  will  be  determined  by  failure  states  £  suc^  that  tp(x)  *  0 
and  |  B  (x)  |  ■  r . 

After  some  algebra  one  obtains  from  (1.1)  that 

P(«t)  »  1  -  tr6rg(X)  (1  ♦  o(l))  ,  (1.3) 

where  X_  «=  (X^.Xj*.. .»Xn)  an<* 

g(I)  =  z  n  x  .  (1.4) 

(x:<p(x)»0  $  |  B  (x)  i*r)  j£B(x;  3 

Thus, 

R(t)  ~  1  -  tVg(X)  ~  exp{-0rtrg(X)}  ,  (l.S) 

which  corresponds  to  the  Weibull  distribution. 

The  role  of  min-cuts  in  getting  an  accurate  approximation  to  system 
reliability  was  discussed  by  Locks,  1980. 

The  formula  (1.2)  and/or  (1.4,  l.S)  can  be  used  for  practical 
purposes  only  if  there  is  an  efficient  method  for  finding  all  minimal - 
size  cut -sets.  For  a  real -size  system  this  might  be  a  rather  difficult 
problem. 

2.  Waksman,  1982,  proposed  a  promising  approach  to  this  problem, 
for  a  particular  type  of  coherent  structures,  namely,  two-terminal  net¬ 
works.  His  approach  uses  a  flow-in-network  technique  a^d  is  based  on 
introducing  a  special  subnetwork  which  is  equivalent  to  the  original 
one  in  the  sense  of  its  asymptotic  analysis. 
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Consider  a  network  -  an  undirected  multigraph-  G  «  (E,V)  -  for  which 
the  failure  is  defined  as  disconnection  between  two  vertices  S  and  T, 
called  terminals.  A  separator  £  in  G  is  a  set  of  edges  ?fiE  such 
that  the  removal  of  ?  disconnects  all  chains  joining  S  with  T. 

Separators  of  minimal  size  are  called  minimum  separators  (this  corres¬ 
ponds  to  the  minimal  cut  sets  in  Barlow  ft  Proschan  terminology).  An 
edge  e  €  ?  is  called  essential  iff  e  is  contained  in  a  minimum 
separator.  Z.  Naksman  introduces  a  subnetwork  G*  ■  (E+,V+)  obtained 
from  G  by  contracting  all  edges  of  G  which  are  not  essential.  It 
turns  out  that  the  main  terms  in  asymptotic  failure  probability 
representation  (1.3)  are  the  same  for  G  and  G*. 

Assume  that  each  e€  E  has  a  maximal  flow  capacity  equal  to  one. It  was  proved 
that  there  is  a  maximum  flow  from  S  to  T  which  saturates  each  essential  edge 
and  does  not  saturate  any  unessential  edge. The  above-cited  paper  contains  an 
efficient  flow-type  algorithm  for  identifying  all  essential  edges.  The 
reduction  of  G  to  G*  already  signifies  a  considerable  simplification 
in  reliability  computation.  The  evaluation  of  the  main  term  in  the 
asymptotic  expansion  for  G+  is  carried  out  by  an  efficient  algorithm 
which  uses  pivoting  decomposition  (see  Barlow  S  Proschan,  1975,  Ch.  1). 

Specific  properties  of  G*  allow  accelerate  considerably  the  computations. 

It  is  easy  to  obtain  simple  formulas  for  g(X)  for  several 
important  particular  cases.  For  example,  for  a  k -out -of -n  system. 


n 

gQ)  -  z  n  x. 

(i. , . . .  ,i  )  k*l  k 
x  r 


* 


(1.6) 
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*  where  r  ■  n-k+1  and  the  simulation  is  made  over  all  ^  ”  J  combinations 
of  r  indices.  Derivation  of  (1.6)  and  als*“>  formulas  for  series- 
parallel  stnictures  can  be  found,  for  example,  in  Gertsbakh,  1982. 

The  formula  (l.S)  for  R(t)  allows  obtaining  a  lower  confidence 
limit  for  R(t)  if  an  upper  confidence  limit  (  (JCL)  can  be  found  for  the 
parametric  function  g(A).  A  method  of  constructing  such  an  UCL  was 
described  in  Gertsbakh,  1982. 

It  is  important  for  practical  applications  to  estimate  the  error 
in  reliability  evaluation  by  formula  (1.5).  In  some  situations,  the 
following  upper  bound  might  provide  good  results: 


-At  -A.t 

0  *  F(t)  -  {  Z  n  e  3  n  (1-e  J  )  )  $ 

{x:ip(x)-0  6  l B (x)  | »r >  j€A(x)  jfB(x) 


n 

(here  A  ■  t  Z  A . )  . 

i»l  1 


*  e 


-A 


Z 

m»r+l 


£ 

m! 


(1.7) 


This  formula  can  be  obtained  by  combining  the  following  two  facts. 

First,  the  markovian  process  v(t)  which  describes  system  degradation 

from  state  (1,1,..., 1)  down  to  a  failure  state 

£E  *  (x_:tp(x)*0  §  |B(x)j  r+1}  should  have  at  least  (r+1)  transitions. 

Second,  the  probability  of  having  at  least  (r+1)  transitions  in  v(t) 

is  no  less  than  the  same  probability  in  a  "majorant"  process  ~(t)  which 

~  n 

has  a  constant  transition  rate  A  *  Z  A. .  But  the  latter  is  a  Poisson 

i-1  1 
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process  and  that  explains  the  fora  of  the  bound  in  (1.7).  This  method,  in 
fact,  was  suggested  in  a  general  fora  by  Kovalenko,  1975,  Sections  2. 6, 2. 7. 

2.  Sy stans  with  Renewal 

2.1.  Introduction.  Let  us  consier  a  system  consisting  of  two  identical 

blocks  1  and  2,  having  exponential  lifetime,  and  one  repair  channel.  The 

repair  time  for  both  blocks  has  same  d.f.  H(x).  At  t  »  0  block  1 

starts  working  while  block  2  is  in  standby.  When  block  1  fails,  block  2 

starts  working  and  block  1  goes  to  repair.  If  block  2  fails  during  the 

repair,  the  system,  by  definition,  had  failed.  Otherwise,  block  1  returns 
to  operation  and  block  2  -  to  standby.  We  are  interested  in  the 

distribution  of  the  time  to  failure  t  of  the  system.  Let  us  call  a 

cycle  the  time  interval  which  starts  by  putting  block  1  into  operation 

and  ends  with  the  completion  of  repair  of  a  failed  block  (type  1  cycle), 

or  with  SF  (type  2  cycle).  Denote  by  5,  n  the  lengths  of  these 

cycles.  It  is  clear  that 

t  -  ♦  e2  ♦  ♦  CN.X  *  n  ,  (2.1) 

i3/ 

where  N  /the  random  number  of  cycles,  are  independent  realizations  of 
r.v.  £.  Let  q  be  the  probability  that  the  cycle  will  terminate  by  a 
SF.  Then  clearly  N  has  a  geometric  distribution: 

P(N-k)  -  (l-q)k-1q,  k  i  1  .  (2.2) 

The  operation  of  many  renewable  systems  until  the  appearance  of  the 
first  SF  can  be  described  in  terms  of  the  model  (  2.1).  It  is  very 
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important  for  reliability  theory  to  know  the  probabilistic  properties  of 
the  r.v.  t.  It  is  typical  for  situations  studied  in  reliability  that  q 
is  small,  which  reflects  the  fact  that  the  average  time  of  normal  operation 
is  much  larger  than  the  average  renewal  (repair)  time.  Therefore,  it  is 
natural  to  investigate  the  distribution  of  t  for  small  values  of  q, 
formally  for  q  ■*  0.  It  turns  out  that  under  quite  general  conditions 
the  appropriately  normalized  r.v.  r  converges  in  distribution  to  an 
exponential  d.f.  with  parameter  X  *  1  . 

2.2.  Keil son's  theorem.  Let  \>(t)  be  an  ergodic  continuous  time 
regenerating  random  process  with  state  space  X.  A  particular  state 
xQ  €  X  has  the  property  that  each  entrance  into  it  is  a  regeneration 
point  of  v(t).  Define  for  each  natural  m  a  decomposition  X  =  X™  ♦  X®  • 
Suppose  xQ  €  Let  (1-q^)  be  the  probability  that  there  will  be 

no  SF  on  a  single  regeneration  period,  where  SF  is  defined  as  entering 
the  set  X?.  Denote  by  u  ,  u  <  ■,  the  expectation  of  the  length  of  one 
regeneration  cycle.  Keilson,  1966,  proved  the  following  theorem. 

Theorem  (Keil son,  1966,  1979).  Let  q^  •+  0  as  m  ■*  •  and  let 

t  *  inf{t:  v(t)  €  X?|v(Q)»xn}.  Then  for  each  x  >  0 
in  *  u 

QT 

lim  P{-SJ5-s  x)  »  1  -  e‘x  #  (2.3) 

The  proof  is  based  on  the  investigation  of  the  limiting  form  of  the 
moment  generating  function  for  r.v.  t  .  The  importance  of  this  theorem 
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stems  from  the  feet  that  only  two  parameters  are  involved  in  the  limiting 
distribution:  the  average  length  of  a  regeneration  period  u  and 
"failure"  probability  on  a  single  regeneration  period. 

Remark.  It  follows  from  the  proof  of  the  theorem  that  y  in  (2.3)  can  be  replaced 

bv  yn  .the  average  (conditional)  return  time  to  xQ  for  those  trajectories  which 
do  not  visit  X^. 

We  demonstrate  an  application  of  Keil son's  theorem  by  an  example 
which  might  be  of  interest  foT  reliability  theory. 

Example.  Asymptotic  distribution  of  the  time  until  a  SMP  gets  out  of  a 
kernel  (Ushakov  &  Pavlov,  1978). 

Consider  a  SMP  v(t)  with  state  space  X  «  (1,2,3,...  ).  Let 

Fij(t)  be  the  one-step  sojourn  d.f.’s  and  let  P  »  l IPij I  I  b®  the 

matrix  of  transition  probabilities.  Let  X  «  Xj  +  X2,  X^^  ■*  {l,2,...,n}. 

X  is  called  a  "kernel".  Define  for  each  i  €  X, ,  t.  ■  Z  p.  ..  It  is 
1  1  1  jex/1; 

assumed  that  are  small  and  let  formally  ■+•  0.  The  Markov  chain 

with  state  space  X  and  transition  matrix  P  has  no  transient  states, 
is  irreducible  and  positive  recurrent.  Assvne  also  that  fox  i  €  X 

OD 

/  F.  (t)dt  s  Const  <  -  (2.4) 

1  j€X  ^0  13 

Let  us  introduce  a  "conditional"  SMP  Vg(t)  with  state  space  X^. 
vQ(t)  is  obtained  from  v(t)  by  setting  «  0  and 
p^  ■  p^/(l-e^).  Assume  that  Vg(t)  is  an  ergodic  process.  Denote 
by  ir?  the  stationary  probabilities  for  the  Markov  chain  P®  ■  l  i  Pi j  I  l 


14 


r 


By  a  well  known  formula  the  mean  return  time  to  the  state  1  in 

I 

i€X,  *  j€X,  +J  0 


vfl(t)  is  w?,  -  Z  #  where  m?  ■  Z  p?,  /  F..(t)dt. 

°  11  \ex  111  i  I'  n 


'1  j€Xx 

We  are  interested  in  the  limiting  distribution  of  r.v. 

t  ■  inf{t:v(t)  €  XjjvCO)*!}  which  is  the  exit  time  of  \*(t)  from  the 

kernel.  The  key  observation  is  that  t  has  the  representation  (2.1), where 

the  return  times  to  state  1  without  visiting  X,  and  n  is  a  "direct"  passage  time 
from  state  1  to  X,,  L 

There  is  a  small  probability  q  that  SMP  v(t)  will  leave  the 
kernel  between  two  consecutive  visits  into  state  1,  because,  as 
postulated,  are  small.  Thus,  Keil son's  theorem  can  be  applied  and 
it  remains  only  to  compute  q.  To  do  that,  let  us  introduce  the  following 
conditional  probabilities: 

■  P{exit  to  X2  during  a  single  regeneration  period,  before 

returning  to  state  1  |  the  regeneration  period  starts  at  state 
i  €  XL). 

Clearly,  ou  satisfy  the  following  system: 


cu  a  £,  ♦  Z 


i  -  Pik  °k* 
i  k„2  ik  k 


i  *  1, . . . ,n  . 


C.  Z.S) 


Dividing  each  equation  by  1-e^,  we  obtain 

n 


a. 


2,  _  “  _,«>), 

k*l 


,(0) 


i  +  Vi  +  0(ei}  *  '  pu  -i  -i 


a,  *  c. 


(2.6) 


Now  multiply  i**1  equation  by  it?  and  sum  up  all  equations.  Using 
the  fact  that  tt®  »  ir®P®,  it®1  «  1,  one  obtains 


are 


IS 


I  *?a.  ♦  £  r?a,e,  ♦  0(e2)  ■  I  ir?a,  -  *?a.  ♦  £  r?e.  , 

i€Xx  1  1  i€Xx  111  ie^  11  11  ieXj  1  1 


where  e  *  max  c. .  From  this 
1 


o-  ■  (  £  *°e.  -  £  *?a.e.  ♦  Ofc2))/*®  . 
1  i€Xj  1  1  i€X1  1  1  1  1 


But  from  the  system  (2.5)  one  can  see  that  cu  ■  O(e^).  Using 
we  see  that 


i£X. 


0 

ir.e. 
i  l 


0 

w. 

l 


♦  0(e2) 


iex, 


0 

Vi 


Thus,  the  normalizing  factor  in  (2.3)  can.be  taken  as 


0 


— .  0  .  _ 

£  ir.e ./  £  it 

iex  1  1  iexx 


0  0 
i"i 
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and  we  obtain  finally  that 

lim  P(Bt  $  x)  *  1  -  e”x 
when  -*■  0  for  i  £  X^  . 

This  result  was  obtained  by  Pavlov§Ushakov  ,  1978,  using  more 
techniques. 


(2.7) 

(2.7), 

(2.8) 

i 

(2.9) 

(2.10) 

complicated 
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2.3.  Generalizations  of  Keilson's  model.  Solovyev 1 s  theorem s. 

Keil son's  theorem  relates  the  fact  that  0  as  m  *.  «  to  the 

changes  in  One  can  think,  for  example,  that  X®  get  "smaller" 

when  m  ■*  <■.  But  this  particular  form  of  the  behavior  of  q^  is  too 
restrictive.  It  is  more  natural  to  consider  a  regenerating  processes 
that  can  change  in  such  a  way  that  the  probability  of  appearance  of  the 
SF  on  a  single  regeneration  period  goes  to  zero.  This  approach  was 
adopted  by  A.D.  Solovyev. 

Let  <(t)  be  a  regenerating  process,  and  t^  “  0  <  <  ...  <  t  < 

instants  of  regenerations.  On  each  regeneration  period  *  t  -  t 

an  event  A  can  occur  at  some  instant  t  ,+n,0<n  $£•  A 

n  n-l  n  n  n  n 

and  are  defined  on  the  trajectories  tnl  <  t  s  tn>  and 

they  are  independent  of  the  behavior  of  ic(t)  outside  this  period.  Let 
r.v.  t  be  the  time  of  the  first  appearance  of  event  A  and  let  ^  be 
the  indicator  function  of  A  .  Define 


*n  *  if  *n  *  0  ; 
.  nn  *  if  *n  *  1  * 


(2.11) 


Let  Cn~FOO,  <P_(z)  -  EtexpC-z^)^],  <p(z)  -  E[exp(-zCn)]  , 
q  *  «p_  (0)  ■  P{An>  •  It:  is  easy  to  obtain  that 

a(z)  -  E[e'ZT]  -  <p_(z)/(l  ♦  q>_( z)  -  «p(z)) 
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q -<p  (*) 

L«t  q  ■  sup  y^y  ,  q0  -  maxCq.q). 

For  the  sake  of  simplicity,  the  subscripts  of  r.v.'s  ?n>  ?n,  Xg 
will  be  dropped.  Denote  also 


/e[cpi  y/(P-D 

MEU))1" 


•q» 


Theorem  1  (Solovyev,  1971) 


(2.12) 


If  the  distribution  of  (5,n,x)  vary  in  such  a  way  that  q  >  0 
and  qQ  •*>  0  and  if  for  same  normalizing  factor  y,  yt  converges  to  a  * 
proper  r.v. ,  then 


lim  E[e‘YZT]  -  (1  ♦  w(z))*1  , 

where 


(2.13) 


i_e 

w(z)  ■  /  — -  dP(x)  ,  P(x)  is  nondecreasing  function  such  that 

0  x 


P(0)  ■  0  and  /  <  •».  A  necessary  and  sufficient  condition  for  the 

1  x 

distribution  (2.13)  to  converge  is  that  for  every  x  >  0, 

lia  /  ldF(i)  -  P(x)  * 

0  H  T 
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Remark  (Solovyev,  1971).  In  the  case  E[g3  *  T  <  •  the  normalizing  factor 
can  be  taken  as  y  *  q/T  and  out  of  all  distributions  in  the  class 
(2.13),  t\e  "normal"  one  is  the  exponential  distribution.  For  it 
P(0)  •  0,  P(x)  ■  1  for  x  >  0,  «(*)  -  z.  All  other  distributions 
arise  as  a  result  of  "pathological"  variation  of  F(x)  as  we  take  the 
limit.  For  convergence  to  an  exponential  distribution  (in  the  case  of 
finite  average  E(c]  »  T),  it  is  necessary  and  sufficient  that  for  every 
x  >  0 

lin  f  -  dF  (~)  •  0  » 

x  *  q 

The  following  theorem  replaces  the  condition  ■*>  0,  which  is 
difficult  to  verify,  by  a  more  practical  one. 

Theorem  2  (Solovyev,  1971) 

If  for  an  arbitrary  p  €  (1,2],  E[g^]  <  <*, 

lim  P(^  >  x)  «  lim  P(^-  >  x}  »  e’x  #  (2. 

9+0  a-+0  1 

P  P 

In  applications  often  the  regeneration  period  G*  has  the  following 
structure:  G**  G'  ♦  5",  where  G'  is  a  random  period  corresponding  to 
system  operation  in  the  absence  of  element  failures  (so-called  "free" 


period);  G"  starts  with  a  failure  of  some  system  element  and  ends  either 
by  a  return  to  a  "brand  new"  state  of  the  system  or  by  a  SF  (g"  is  called 
"busy"  period).  In  all  subsequent  examples  g"  will  correspond  to  system 
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operation  when  some  of  its  elements  are  being  repaired.  The  period  5", 
on  the  average,  is  very  small  in  comparison  with  E[;'],  which  reflects  a 
typical  "fast  repair"  situation. 

The  following  theorem  given  in  Gnedenko§Solovyev,1974 .provides  simple 
sufficient  conditions  for  the  asymptotic  exponential ity. 

Theorem  3. 

If  c'  ~  Exp (X0),  then 

lim  A.qt  >  x}  »  eX  #  (2.15) 

X0.E(C"H)  0 

The  most  difficult  part  of  applying  the  theorems  given  above  to 
particular  situations  is  (1)  checking  the  conditions  providing  asymptotic 

exponential ity  and  (2)  finding  the  normalizing  factor  for  the  r.v.  t. 

The  latter  demands,  as  a  rule,  considerable  analytic  efforts  and  involves 

technical  "tricks". 

2.4.  Applications  of  theorems  of  2.3  to  reliability  problems. 

We  survey  in  this  section  several  important  examples  of  applying 
the  general  theorems  given  in  2.3  to  particular  reliability  models. 

Example  1.  A  GI |G I rl  Cm-r)- system  (Solovyev,  1970). 

A  system  has  (m+1)  identical  elements.  One  and  only  one  of  them 
is  operating  and  all  others  are  in  a  "cold"  standby.  The  lifetime  of 
the  operating  element  is  X  ~  F(x),  E[X]  *  1.  When  this  element  fails. 


it  enters  the  repairing  device  which  has  r  identical  repair  channel s, 
each  one  being  able  to  repair  one  failed  eleaent.  The  place  of  the 
failed  eleaent  is  taken  by  an  other  eleaent  from  the  standby.  The 
repair  tiae  for  each  eleaent  is  Y  «*•  G(x).  If  no  repair  channel  is 
available  for  a  failed  eleaent,  it  willswait  in  a  line.  Thus,  the 
normal  circulation  of  elements  is  operation-waiting  for  repair-repair- 
standby-operation,  etc. 

Assume  that  at  the  initial  moment  t  ■  0  the  functioning  element 
has  failed  and  all  other  a  elements  were  in  standby.  SF  happens 
when  at  the  instant  of  the  failure  of  the  operating  element,  all  other 
elements  are  either  in  repair  or  waiting  for  it,  i.e.,  the  standby  is 
empty.  Speaking  in  terms  of  an  Gl|G|r[ (a-r) -system,  the  SF  appears 
when  a  customer  arrives  to  a  service  device  when  all  r  service  positions 
and  all  m-r  waiting  places  are  occupied.  bet  K(t)  be  the  number  of 
customers  in  service  at  time  t  ,  i.e.  the  number  of  failed  elements  at  time  t 

Time  instants  t^,  tQ  *  0  <  t^  <  t^  <  . • .  at  which  elements  fail 
in  the  presence  of  r  empty  service  channels  are  the  regeneration  points 
of  k  (t ) . 

Assume  that  element  failures  took  place  at  the  instants  *  0, 

t2  *  yl*  t3  *  yi  +  y2*‘ ’* ,Tm+l  *  yl  *  +  ym’  Consider  the  following 

trajectory  leading  to  a  SF:  i1*1  service  channel  is  busy  during  the  time 
interval  3  *  i  ■  l,...,r.  It  is  clear  that  at  the  instant  t  ^ 

the  system  will  fail .  The  event  M  »  {no  repair  has  been  completed  before 
the  (m+l)tfl  failure}  has  the  probability 
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P<M>  -  q0 


G(y1-*-...^yo)..  .5(yr+...+ym)dF(y1)...dF(ym)  . 


(2.16) 


The  following  proposition  which  can  be  found  in  Solovyev's  paper,  1971, 
gives  sufficient  conditions  for  asymptotic  exponent! ality  of  r.v.  t,  the 
tine  to  SF,  and  the  form  of  the  normalizing  factor. 


If 


(i) 

E[X]  - 

1,  F(x)  is  fixed,  |F'  (: 

F'  (x) 

is  continuous 

at  zero; 

(ii) 

G(x)  - 

G°r|).  G°(x) 

is  fixed 

(iii) 

Vl  * 

;  x“+1  dG°(x) 
0 

<  -  , 

X, 


Then 


lim  P(qt>x}  ■  e~x  ,  where 
e-*0 


q  ~  <*0  ~  (Xc)" 


m-r 

x 

(m-r) ! 


[/  fi°(u)du 


-.r-1 


G-°00 

(r-1)! 


dx 


* 


(ii)  expresses  the  fact  that  the  service  is  "fast";  (iii)  is  used  in  the 
proof  that  q  ~  qQ. 

Example  2  -  a  general  model  of  standby  with  renewal  (Gnedenko  6  Solovyev,  1974). 
Let  us  consider  the  system  of  Example  1  with  the  following  modification: 
each  element  which  is  not  in  the  repair  and  is  not  waiting  for  repair  can 
fail  and  has  failure  rate  X^  depending  on  the  total  number  of  nonfailed 
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elements  k.  Regeneration  points  of  <(t)  are  the  instants  when  ic(t) 

enters  state  0.  The  regeneration  period  is  c*=  c*  ♦  c",  where  z" 

are  independent,  is  a  "free"  period  for  which  tc(t)  *  0  and  c" 

is  a  "busy"  period  for  which  tc(t)  >  0.  Clearly,  -'Exp  (Xq).  Denote 

by  q  the  probability  that  the  SF  appears  on  a  busy  period;  let 
00 

T  *  /  xdG(x).  The  following  theorem  is  the  key  for  investigating  this 
0 

example. 

Theorem  (Solovyev  $  Gnedenko,  1974) . 

lim  PlX.qr  >  x}  *  eX  .  (2.17) 

T-0  U 

Proof.  Let  us  consider  a  "majorant"  process  ic(t)  with  respect  to  ie(t), 

which  is  constructed  as  follows.  Replace  all  element  failure  rates  by 

X  *  max  X,  ,  and  replace  r  service  channels  by  one  channel.  The  busy 
k  k 

period  c"  for  te(t)  will  exceed,  on  the  average,  the  budy  period  c" : 

E[$"]  i  E[t"].  From  the  queueing  theory  it  is  known  that 

E(5"]  *  1/  (1-XT).  Since  E[£"J  -*■  0  as  T  0,  E[c"]  "*■  0,  and  it  remains 

to  apply  theorem  3  of  Section  2.3.  # 

It  should  be  noted  that  introducing  a  "majorant"  random  process  is  a 
very  typical  way  of  proving  theorems  similar  to  the  above.  The  following 
condition  reflects  "fast"  repair: 

/  ym+1  dG(y)/T“  -  0  . 

0 


(2.17a) 
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Obviously,  it  guarantees  that  T  ■*  0.  Similar  to  the  case  of  Exaaple  1, 
it  was  proved  that  given  (2.17a),  q  ~  qg  ■  P(M)  •  P  {no  repair  has  been 
completed  on  the  busy  period}. 

Simple  formulas  were  derived  for  qQ  for  particular  cases  r  ■  m 
and  r  *  1: 

For  r  *  m 


*0 


X1X2* 


m! 


.X 

m 


G 


xdG(x) 


V 
;  * 


(2.18) 


For  r  ■  1 


*0 


XlX2”'Xm 

ml 


J  x“dG(x)  . 
0 


(2.19) 


Example  3  -  "hot"  standby  with  renewal  (Solovyev,  1971) .  The  system 
consists  of  m  elements  each  of  which  operates,  fails,  is  repaired, 
operates  again,  etc.,  independently  of  all  other  elements.  The  state  of 
the  system  at  instant  t  is  described  by  a  vector  x(t)  »  (x,(t),...,x  (t)), 
where  x^(t)  >1  if  element  i  is  in  operating  condition  at  time  t  and 
x^(t)  =  0,  otherwise.  Let  us  suppose  that  the  set  E  of  2m  states  of 
the  system  is  partitioned  into  two  subsets  E  =  E+  +  E  ,  where  is 

the  set  of  "good"  states  and  E  is  the  failure  set.  The  problem  is  to 
find  an  asymptotic  distribution  of  x,  the  system  failure-free  operation 
time:  x  »  inf{t:x(t)  €  Ejx(0)  *  (1,1,...,!)}. 
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Assume  that  the  lifetime  of  i**1  element 
the  repair  time  ~  G^(y).  For  simplicity, 
ing  notation  will  be  used: 

m  m 

Tj  *  E[Yj]  ,  G(t)  -  Z  X^t).  Tq  -  Z  X^, 


~  Exp(X^)  and  that 
m 

Z  X.  ■  1.  The  follow' 
•  1  1 


[  Xi"i 


The  regeneration  cycle  of  x_(t)  consists  of  two  independent  parts: 

C1,  on  which  £(t)  ■  (1,1,..., 1)  and  c",  on  which  xOO  <  (1,1,..., 1). 

The  fast  repair  situation  is  reflected  by  the  demand  that  -*■  0. 

It  can  be  proved  that  in  this  case  -*■  0  and  E[c"]  -*■  0.  The  main 
tool  for  proving  these  facts  is  again  replacing  the  original  x(t)  by 
another  process  £(t)  which  in  this  case  corresponds  to  a  number  of  customers 
in  an  M|M|l -system  with  input  flow  with  parameter  X  ■  1 .  Note 

that  E[c*  ♦  c"]  -  1  ♦  E(c"]  -*-1  as  mQ  0.  Thus,  theorem  2  of  2.3 
shows  that 

lim  P(qx  >  x}  »  ex  .  (2.20) 

V° 

It  is  more  difficult  to  find  an  asymptotic  estimate  of  q.  It  turns  out 

that  if  Z  (=— ■)  •*  0,  then 
k-1  ' k' 

n  l  * 

q~q'-  I  X(x)  n  (X  T  )l~xi  (2.21) 

x€E+  i*l  1  1 

where  X(xf)  is  system  failure  rate  for  the  state  x  €  E+. 
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Brown,  1975,  considers  a  special  case  of  the  system  described  in 
Example  3,  for  which  E_  has  only  one  state,  namely  x  ■  (0,0,..., 0) 
and  all  repair  times  Y1  ~  exp(Ui).  The  author  proves,  using  mainly 
the  Laplace  transform  technique,  the  following  theorem. 


Theorem  (Brown.  1975) 

If  all  >  0,  at  least  one  X^^  <  «,  all  y^  <  «,  at  least  one 
y^  >  0,  and  X^,  y^,  m  change  in  such  a  way  that 


log  m 


m 

E 

1 


“i 


xi'“i 

X. 

X 


•{  min 
l<i$m 


CVV> 


(*) 


then  t/E[t]  converges  in  distribution  to  an  exponential  r.v.  with 
parameter  1  # 

Brown's  condition  (*)  reflects  the  "fast"  repair. 


Example  4  -  renewable  system  with  redundancy  (Gnedenko  6  Solovyev,  1975) 

Let  us  consider  the  system  of  Example  3  with  some  additional  features 
added.  If  the  state  of  the  system  is  x.(t)  at  time  t,  then  the 
probability  of  the  failure  of  the  i**1  element  in  the  interval  [t,t+h]  is 
X..[x(t)]h  ♦  o(h),  i.e.,  this  probability  depends  on  the  state  of  the  whole 
system  x(t).  Besides,  there  are  r,  r  s  m,  repair  channels,  the  repair 
time  of  element  i  on  the  repair  channel  j  is  ~  G^(y),  and 
E[Yjj]  •  T_.  It  is  assumed  that  for  each  element  i  there  is  a  set 


0 
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of  repair  channels  able  to  perform  its  repair.  The  repair  of  failed  elements 
begins  either  at  the  instant  of  its  failure  (if  the  appropriate  channel 
is  free)  or  at  the  instant  at  which  a  repair  of  some  other  element  has 
been  completed. 

It  will  be  assumed  that  element  failure  rates  are 'small,  formally 

that  they  have  the  form  oX^  (x) ,  where  X^  (x)  are  fixed  and  a  0 . 
m 

Let  X(x)  «  Z  X.  (x)  ,  where  X^x)  “0  if  x.^  -  0  . 
i*l 

As  in  the  previous  cases,  the  problem  is  to  find  the  asymptotic 
distribution  of  r.v.  t 

t  «  inf{t:x(t)  G  E  |x(0)  *  (1,1,..., 1)} 

The  following  theorem  based  on  theorem  3  of  2.3  establishes  the 
asymptotic  exponentiality. 


lim  P{ 
XTK) 


m 


>  x}  *  eX 


# 


(2.22) 


It  is  intuitively  clear  that  E[t]  ■  (X (x,(0))q) ** ,  where  q  is  the  SF 
probability  on  a  single  regeneration  period.  It  will  be  very  instructive 
to  follow  the  main  lines  of  finding  an  asymptotic  expression  for  q. 


0 
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Lot  us  consider  the  class  D  of  all  trajectories  of  x(t)  leading 

from  the  state  x  »  (1,1,... ,1)  into  the  failure  set  E  .  A  trajectory 

d  *  (x(0)  ■»  ,0)  -*>...  +■  £«)  is  called  monotone  if  xS^  >  _x  ^  >  ... 

...  >  *«.  For  example,  the  trajectory  (1,1,1)  (1,1,0)  -►  (0,1,0) 

m 

is  monotone.  Denote  1 1 x|  |  ■  m  -  £  x.  (||x)|  is  the  number  of  failed 

i»l  1 

elements  corresponding  to  the  state  x). 

The  state  x'  C  E  for  which  | | x' | |  ■  s  *  min  | |x| |  is  called 

x€E_ 

minimal  system  failure  state,  or  minimal  state.  A  monotone  path  leading 
from  x  »  (1,1,..., 1)  to  a  minimal  state  is  called  a  minimal  monotone 
path.  Let  0Q  be  the  set  of  all  such  paths.  Then 

D  -  Dq  +  Dx  ,  (2.23) 

where  is  the  class  of  all  other  paths.  Let  q(d)  be  the 
probability  that  the  SF  will  occur  along  a  path  d.  Then 

q  -  Z  q(d)  -  Z  q(d)  ♦  Z  q(d)  .  (2.24) 

dCD  d€DQ  d€D1 

The  crucial  fact  is  that  for  a  ■*  0,  q  ~  qn  ■  Z  q(d).  In  other 

ie>0 

words,  the  "main"  part  of  q  corresponds 

to  the  "shortest"  way  of  failure  appearance^, '  i .  e . ,  along  the  minimal 
monotone  paths . 

Gnedenko  §  Solovyev,  197S,  present  several  explicit  formulas  for  qQ 
for  important  particular  cases.  For  example,  if  (y)  ■  G^(y), 
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E[y„J  *  T.^  X.(x>  »  each  element  can  be  repaired  on  any  channel 


and  r  *  a,  then 

(E[t])  «*  £  Xk(i)Xk(2)‘*'Xk(s)Tk(l),,,Tk(s)frk(l)  *'*  +  Tk(s)}  ’  (2,25) 


where  the  sum  is  taken  over  all  minimal  system  failure -states,  and 
k(l)  <  k(2)  <  ...  <  k(s)  are  the  numbers  of  failed  elements  in  the 
minimal  failure  state. 


If  r  3  1,  then 


s 


(E[t])'~<x  1  xk(l)Xk(2)*  **Xk(s)(ns-l,k(l)  +,,,+  Vl.kCs)^ 


(2.26) 


c  — 1 

where  m  .  *  E[Y.  ]  and  the  sum  is  similar  to  that  in  (2.25). 

S-I *1  1 

A  problem  which  is  very  similar  to  that  described  in  Example  4  was 
considered  in  a  less  general  setting  by  Ovchinnikov,  1976. 


A  useful  summary  of  main  reliability  indices  of  various  types  of 
systems,  for  which  the  asymptotic  exponentiality  of  time  to  failure  is 
valid,  can  be  found  in  the  book  by  Kozlov  6  Ushakov,  1975,  Sec.  4.2. 


2.5.  Reliability  models  in  terms  of  queueing  theory.  The  models  considered 
in  Section  2.4  can  be  translated  into  the  language  of  queueing  theory. 

When  the  system  is  normally  functioning  it  generates  a  flow  of  failed 
elements  (’'customers")  which  need  to  be  served  (repaired)  .  SF  appears 
when  an  element  fails  in  the  presence  of,  say,  m  elements  which  have 
already  failed.  In  queueing  theory  terms,  this  corresponds  to  the  loss 
of  a  customer  who  had  arrived  to  a  servicing  device  when  all  r  service 


channels  and  all  (jn-r)  waiting  places  are  occupied. 

The  difference  between  reliability  and  queueing  problems  is  in  the 
fact  that  reliability  theory  is  usually  interested  in  the  case  of  the 
low  intensity  traffic  (this  corresponds  to  fast  repair),  while  the  classical 
queueing  asymptotics  deals  with  high  traffic  intensity. 

The  paper  of  Vinogradov,  1967,  deals  with  a  Gl|M|l| (n-1) -system. 

The  interarrival  time  has  d.f.  F(y)  which  varies  that 

«■ 

oQ  *  /  e-tdF(t)  -  0. 

Let  t  be  the  moment  of  the  first  loss  of  a  customer.  The 
n 

general  class  of  limiting  distributions  for  the  r.v.  Tn*T(a0)  is 

investigated.  In  particular,  it  is  proved  that  if 

*  2  -x 

/  t  dF(t)  <  •  and  on  -*■  0  then  P{t  /Eft  ]  >  x}  e  .  The  paper 
0  u  n  n 

by  Vinogradov,  1974,  studies  an  M|G[l-system  with  fast  service:  the 
service  distribution  time  approaches  zero  in  probability.  It  is  proved 
that  P{Tn/E[tn]  >  t}  -*■  e-t,  where  is  the  instant  at  which  the  queue 

length  reaches  the  level  n  for  the  first  time. 

Solovyev  §  Zaitsev,  1975,  consider  an  M j G 1 1 1 (k-l)-system  with  a 

.  * 

Poisson  input  flow  having  a  variable  parameter  h  (t) .  The  service  time 

Y  ~  G*(y).  The  problem  of  finding  the  asymptotic  distribution  of  r.v.  t^, 

the  time  of  the  first  loss  of  a  customer,  is  investigated.  The  central 

result  obtained  is  the  following 
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Theorem.  If  h*(t)  ■  h(t)/B,  G*(t)  ■  G(t/a),  y  *  a/'B,  6  »  y^» 

•  k 

n.  ■  /  t  dG(t),  then 
*  0 

lim  P{t.  >  t}  *  exp{-  /  hk+1  (x)dx)  .  # 

r*0  0 

Asymptotic  analysis  for  a  nonstationary  input  flow  involves 
considerable  analytical  difficulties.  They  are  caused  mainly  by  a  formal 
necessity  to  avoid  pathological  behavior  of  h*(t). 

An  investigation  of  an  M|G|r-system  with  a  limited  waiting  space 
and  a  nonstationary  input  flow  was  carried  out  by  Zaitsev  §  Solovyev,  1975. 

2.6.  Exponential it y  in  Birth-and -Death  Processes.  Birth-and -Death 

(ED)  process  is  perhaps  the  most  useful  type  of  random  processes  in 

applied  probability  in  general  and  in  reliability  theory  in  particular. 

"The  central  role  in  applications  is  played  by  the  r.v.  t^,  the  passage 

time  from  state  0  (a  "new"  system)  to  state  m  representing  the 

failure  of  the  system.  We  survey  in  this  section  several  basic  results 

concerning  the  asymptotic  behavior  of  the  r.v.  r_  and  related  r.v. 's. 

um 

Let  us  introduce  some  notation  for  a  BD -process.  The  process  itself 

is  denoted  by  v(t),  its  state  space  X  -  (0,1,2, ... ,m,m+l, ...) .  X  , 

n  i  0,  p  ,  n%l  denote  the  "upward"  and  "downward"  transition  rates, 
n 

Quantities  8^,  i  >,  0,  are  defined  as 

60  *  X*  ®n  *  X0  X1  •••Xn-l/wlw2***V  n  *  1  ’ 
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and 

■  inf{t:v(t)«*|v(0)«k}  .  • 

Expectations  of  are  E^t^]  »  It  will  be  assumed  that  the 

BD-process  is  ergodic. 

Let  us  consider  an  example  from  reliability  illustrating  the  use 
of  BD-processes . 


Example  -  a  system  with  standby  and  renewal  (Gnedenko  et  al.,  19691. 

A  system  has  N  *  n+d*£+s  similar  elements,  n  elements  must  always 
work  and  their  failure  rate  is  X.  d  elements  are  in  a  "hot" 
(preoperation)  standby  and  they  have  the  same  failure  rate.  I  elements 
are  in  a  "warm"  standby  and  have  failure  rate  8,  8  <  X.  s  elements  are 
in  storage  (cold  standby)  and  their  failure  rate  is  0.  Failed  elements 
enter  a  repair  shop  which  is  able  to  repair  simultaneously  not  more  than 
r  elements.  The  repair  time  for  each  element  has  an  exponential 
distribution  with  parameter  u.  If  repair  facilities  are  busy,  failed 
elements  wait  in  a  line.  Each  operating  element,  which  has  failed, 
should  be  immediately  replaced  by  an  element  from  the  preoperating 
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standby;  its  place,  in  turn,  is  taken  by  an  element  from  the  warm 
standby.  Elements  in  warm  standby  are  replaced  by  elements  from 
storage.  Elements  leaving  the  repair  shop  join  the  storage. 


The  state  of  the  system  at  time  t  can  be  described  by  the  number 
v(t)  of  failed  elements.  v(t)  is  a  BD-process  with  transition  rates 


(n*d)«X  ♦ 

(n+d)*A  +  B(£+s-k)  , 
(n+d.  ♦  l  *  s  -  k)A  , 


0  <  k  <  s  ; 
s  <  k  s  s  *  l  } 
s  ♦  t  <  k  s  N  . 


ku  , 

k  $  r 

ry  , 

r  >  r 

(2.26) 


System  failure  in  this  case  is  the  event  that  v(t)  reaches  the  state 
m»d  +  £  +  s  +  l,  which  means  that  the  number  of  operating  elements 
dropped  below  n.  So,  the  main  reliability  index  is  expressed  through 
d.f.  of  r.v.  r0m. 

It  is  not  difficult  to  find  the  exact  distribution  of  t_  by 

um 

using  ordinary  methods,  but  all  computations  are  very  cumbersome. 
Usually,  the  parameters  A^,  ui  and  the  level  m  are  such  that 
reaching  m  by  v(t)  is  a  "rare"  event.  Thus,  it  is  natural  to 
investigate  the  asymptotic  behavior  of  x^. 

For  a  simple  case  of  fixed  A^,  wn  and  o  ■*  «,  the  limiting 
distribution  of  can  be  obtained  as  a  corollary  of  Keilson's 
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theorem  (see  Section  2.2).  Indeed,  let  ■  (0,1,2, ... ,m-l), 

X 2  ■  (m,a+l, . . . ),  *o  *  clearly,  ^  0  for  an  ergodic  process  as 

■  and  r.v.  ToB/*gm  will  converge  in  distribution  to  the 
exponential  r.v.  But  this  approach  is  of  limited  practical  importance 
in  reliability  applications  for  the  following  reasons.  In  reliability, 
the  critical  level  m,  which  is  usually  the  number  of  failed  elements, 
is  almost  never  large;  on  the  other  hand,  the  parameters  XR,  yn 
often  depend  on  the  number  m  (see,  e.g.,  the  previous  example)  and  a 
direct  application  of  Keilson's  theorem  is  impossible. 

Necessary  and  sufficient  conditions  for  the  asymptotic  exponential ity 
of  were  found  by  Solovyev,  1972.  Two  of  his  principal  results 

are  presented  in  the  following 


Theorem  (Solovyev,  1972) 

Suppose  that  X^,  y^  and  m  vary  in  an  arbitrary  way. (i) In  order  that 

lim  >  x}  -  ex  (2.27) 

0m 

it  is  necessary  and  sufficient  that  a  _  -*■  0,  where 


a.  2 


1  ®-1  -1  k 
TT  Z  Z  9s  T0s  * 

T0m  k"°  *"° 


(2.28) 


(ii) 


max  |P{t  >t}  -  exp(-t/T )| 
0st<- 


m,2 


# 


(2.29) 


The  proof  of  this  theorem  is  based  on  an  ingenious  analysis  of  the 


distribution  of  Tq#. 

Let  us  show,  following  Gnedenko  et  al.,  1969,  Section  6.4,  how 
to  apply  the  above  theorem.  X^  corresponds  to  element  failure  rates 
and  -  to  element  repair  rates.  Normally,  X^  «  which  reflects 
the  "fast''  repair  case.  Formalizing  this  property,  let  us  write 
X^  *  X^a  and  assume  that  a  0.  Obviously, 


-  —  k  -  k 

^  *  (Xq.  .  *  e^a  . 


It  can  be  proved  that 


m  m“1  -1 

a  . ~  X9a  •  ly  . 
m-i  m-i  ^  i 


Thus  a  -  0  as  a  -*■  0  and  by  the  Theorem, 

Bl}* 

p{t0b  >t}M  exP{-t^0a}  ’ 

The  following  formula 


(2.30) 


(2.31) 


P{t0n  >  t}  *  exp{-(t-a)/  (t^  -  a) } ,  (2.32) 

m-1 

where  a  •  I  y is  more  precise  and  its  relative  error  has  the 
1  1 

magnitude 

*0m  ' 

Several  important  characteristics  of  a  BD-process  related  to  the 

passage  time  such  as  ergodic  and  quasi -stationary  exit  times  were 

studied  by  Kei Ison, 1975, 19 79. 
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Ergodic  exit  tine  from  X^  to  ,  is  defined  as  a  passage 

tine  fron  X  to  X.,  assuming  that  the  initial  state  distribution  for 

1  A  • 

i  eXj  is 

p?  ■  ir./  Z  r.  ,  i  »  0,1,..., m-1  ,  (2.33) 

1  1  i€Xx  1 

where  ir  is  the  stationary  probability  of  state  i. 

Suppose  that  v(t)  has  been  running  for  a  very  long  time  T  and 
all  that  time  it  was  in  the  set  X^ .  Let 

p9  *  lim  P{v(t)*i[v(t')  €  X.,  t-T  $  t*  $  t}  .  (2.34) 

1  T-*»  1 

It  is  shown  in  Keilson,  1979,  Sect.  6.6  how  the  vector  p^  *  (Pq, ••••P^  ^ ) 
can  be  expressed  through  the  parameters  of  BD-process  (see  Keilson,  1979, 
Sect.  6.6,  6.5). 

Quasi -stationary  exit  time  is  defined  as  a  passage  time  from  to 
X2  assuming  that  the  initial  state  i  €  X^  has  the  probability  p9. 

This  index  has  a  special  importance  for  reliability  theory  because 
often  it  is  necessary  to  predict  system  reliability  given  that  for  a 
long  time  it  has  been  working  without  failures,  i.e.,  formally,  it  has 
spent  an  infinite  time  in  the  set  X^ 

A  surprising  fact  about  is  that  TQ1I/^Qm  has  an  exact 

exponential  distribution  with  A  »  1.  (see  Keilson,  1975,  1979). 

The  following  theorems  summarize  the  basic  facts  about  the  asymptotic 

0m'  TEm'  TQm  ' 


behaviour  of  t 


Let  v(t)  be  an  ergodic  BD-process  governed  by  (*n»pn)  with 
Xj  *  (0,1, . . .  ,m-l) .  Let  ^n/yn  P  <  1  as  n  -*■  *».  Then 

(i)  Vl,m/T0m  ^  as 

(ii)  t^,  t^,  are  asymptotically  equal  as  a  -►  » 

(iU)  P{Vl,n/*0ra  >  x}  ^  (1_p)e"X  as  m  -  -  # 

Theorem  2  (Keilson,  1979) 

For  any  ergodic  BD-process.  for  vdiich  "r^  •  as  m 

T0m^0m*  TE*/?0m’  X^0m  conver*e  in  distribution  to  r.v. 

Y~Exp(l).  # 


2.7.  Main  event.  Asymptotic  invariance. 

The  most  difficult  part  in  finding  the  normalizing  constant 
for  r.v.  x  is  determining  q,  the  probability  of  SF  on  a  single 
regeneration  period.  Generally,  q  can  be  represented  in  a  form  of 
asymptotic  series  q  *  q^  ♦  q^^  ♦  q^  ♦  . . .  ,  where  q^+1  *  o(q^).  Thus 
q  in  the  normalizing  constant  can  be  replaced  by  qQ  ~  q.  The 
quantity  qg  has  a  transparent  probabilistic  meaning  and  always  is 
a  probability  of  some  event  termed  in  the  literature  as  "main"  event. 
Let  us  return  to  example  4  in  Section  2.4  and,  following  Gnedenko  § 
Solovyev,  1375,  have  a  closer  look  at  the  relation  between 
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Z  q(d)  and  Z  q(d). 
d  €D  d  €Dq 

Let  d  ■  {£(0)  -*  x^  ...  x^sH  €  Dq,  and  let  k(i),  i  «  1,2,. ..,s, 
be  the  numbers  of  failed  elements  on  the  d- trajectory .  q(d)  can  be 
represented  in  the  following  general  form: 


q(c0 


X(x(0))  Ak(l)  —  JAk(2)'-- 


fx(s-l)>  5-1 
k(s-l)  —  )o 


/.../ 

<xy1<*  •  -Kys.i 


Gk  (0) ,  j  (0)  <WGk (rx)  ,  j  Crx)  (ys-l 


X 


exp[-(X(x(‘1))y1  +  XCx(2))(y2-y1)**-)o]dy1...dys  x  .  (2. 35) 


Indeed,  the  elements  with  numbers  k(0),k(l), . . .  fail  at  t  *  0, 

t  -  yj.-.-J  elements  with  numbers  k(0)  ,  k(r]),...,  begin  immediately  their  repair, 

and  other  elements  wait  for  their  turn;the  repair  of  those  elements  which  started  their 

repair  without  waiting  does  not  end  before  the  instant 

/of  s-th  failure.  This  corresponds  to  a  SF  on  the  trajectory  d  €  D^. 

From  (2.35)  it  is  easy  to  show  that  q(d)  ~  Const*aS_*  ,  if  /  yS  ^dGCy)  <  •  . 

0 


Lemma  (Gnedenko  S  Solovyev,  1975) 


q!  -  Z  q(d)  =«  o(  0s'1  )  .  (2.36) 

d€D1 

Proof.  Obviously,  the  total  number  of  element  failures  on  any  d  6 
exceeds  s.  Let  A  *  (more  than  s  element  failures  preceded  the  system 
failure}  and  let  B  *  (the  regeneration  cycle  does  not  end  at  the 
instant  of  (s+l)^  element  failure}.  Clearly  AcB  and  P{A}  s  P(B}. 
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.Now  replace  the  random  process  x(t)  by  a  majorant  process  x  (t)  which 

arises  if  all  failure  rates  are  max  X(x)  ■  X,  G. . (y)  ■  G(y)  and  the 

x 

number  of  repair  channels  r  ■  1.  Let  C  *  {the  ,rbusy"  period  did  not  end 
at  the  appearance  of  (s+l)^  failure}.  Clearly,  P{B}  i  P{C}.  Let 
nO*nl’*“'ns  1,6  the  reP*ir  tiaes  for  failures  which  appear  at  0,y1,..;,ys 
and  let  J  •  {nQ  ♦  ♦  . . .  ♦  ns  >,  yg  ,  yg  >  0  }  .  Then  C  s  J  ,  P{C>  «  P{J>  . 

^-et  Gs+i(x)  denote  the  d.f.  of  *  ...  ♦  ^.Combining  all  inequalities  we  get 

qj  <  P{J}  -  /  exp(-1ax)dGs+1(x)  *  J  ysdG(y)  -  0(aS)  , 

(2.37) 

which  completes  the  proof.  # 

The  events  denoted  by  M  in  Examples  1,2  in  Section  2.4  are 
also  "main"  events. 

It  is  worthwhile  to  note  that  the  role  played  by  the  main  event  in 
a  renewable  system  is  similar  to  that  played  by  the  event  of  a  failure  of 
all  elements  constituting  minimal  cut-sets  in  a  nonrenewable  coherent 
system  (see  Section  1). 

We  note  that  qQ  is  the  only  parameter  of  the  asymptotic  distribution 
which  might  depend  on  the  properties  of  repair  time  d.f.  If  we  check 
formulas  (2.18),  (2.25)  in  Section  2.4  we  see  that  q^  in  both  of  them 
depends  only  on  the  average  value  of  the  repair  time.  This  phenomenon 
was  termed  by  A.D.  Solovyev  as  "asymptotic  invariance"  .  It  takes  place 


only  when  the  main  event  corresponds  to  such  a  system  failure  history  in 


39 


which  every  failed  element  entered  the  repair  channel  without  delay 

(compare,  e.g.,  with  (2.19)).  It  is  interesting  to  note  that  a  similar 

invariance  of  stationary  probabilities  with  respect  to  the  form  of 

service  time  d.f.  was  established  long  ago  for  an  important  class  of 

queueing  systems  with  losses.  Let  pk  be  the  stationary  probability 

that  there  are  k  customers  in  an  M|G|n- system,  0  s  k  *  n. 

Sevastyanov,  1957,  proved  that  p^  can  be  computed  by  the  well-known 

Erlang  formulas  which  involve  only  the  input  flow  rate  X  and  the 

« 

average  service  time  y  ■  /  xdG(x).  An  up-to-date  information  about 

0 

invariance  in  queueing  systems  can  be  found  in  a  recent  paper  by 
Dukhovny  $  Koenig sberg,  1981. 

2.8  Bounds  on  deviation  from  exponentiality.  These  bounds  are  of  great 
interest  for  engineering  applications.  Solovyev,  1971,  derives  an 
estimate  of  the  rate  of  convergence  to  exponential  distribution  for 
regenerating  process  considered  in  Section  2.3.  His  main  result  is 
the  following  theorem. 

Theorem. 

Let  E[c]  ■  1,  $(t)  ■  P(qr  <  t},  2  <  p  j3,  E[?k]  *  m^, 

ElCkx]  *  qk  then 

sup|$(y)  -  1  ♦  «"y  |  <  CB  /(p-2)  ,  (2.38) 

y*0  p 


where  C  is  an  absolute  constant  and 
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gp  -  oaxtOnp)1^”1^  q2/®2»ap]  *  (2.39) 

is  defined  in  (2.12)  #  . 

For  p  *  3,  C  m  12  and  in  all  known  cases  g  ■  0(a  ).  Denote 

P  P 

by  q(x)  ■  P{A|c  -x},  the  conditional  probability  of  event  A  given 

C  »  x.  If  q(x)  +  (x),  then  g  ■  a  . 

P  P 

Bounds  for  BD-process  can  be  found  in  Solovyev,  1972,  and  one  of 
them  is  given  by  (2.29). 

Solovyev  $  Sakhobov ,  1976,  consider  a  renewal  process  of  a  special  fora 
for  which  the  renewal  period  consists  of  two  independent  parts.  The 
first  part  has  an  exponential  distribution  with  parameter  X  while  the 
second  has  an  arbitrary  distribution  with  finite  expectation  T.  Event 
A  can  appear  on  the  second  part  with  probability  q,  and  the  appearance 
of  this  event  is  determined  completely  by -the  behavior  of  the 
process  on  the  second  part  of  the  renewal  period.  Let  W(t)  ■  P(t  s  t}, 
where  t  is  the  moment  of  the  first  appearance  of  event  A.  It  was 
proved  that 

exp(-Xqt)  $  W(t)  S  exp(-Xqt)  +  XT  .  (2.40) 

In  order  to  apply  this  formula  it  is  desirable  to  have  two>sided 
estimates  for  the  quantity  q.  Sakhobov  6  Solovyev,  1977,  give  such 
estimates  for  a  renewal  process  which  is  related  to  an  M|G| 1-system 
for  which  the  input  flow  intensity  depends  only  on  the  number  £(t)  of 
customers  in  the  system  at  time  t.  If  £(t)  ■  k,  then  the  probability 
of  an  arrival  of  a  new  customer  in  the  interval  (t,t+h)  is 
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Xfch  ♦  o(h).  Denote  t  »  inf{t:£ (t)«n+l [5 (0)«0>.  Clearly,  £(t)  is 

a  regenerating  process,  and  the  instants  of  regeneration  trt,t. 

•  u  1 

are  the  times  when  £ (t)  enters  state  0.  t  ,  -  t  a  C*  +  c",  c' 

n+i  n 

is  a  free  period  on  which  5(t)  -  0  and  c"  is  the  busy  period  where 
C(t)  >  0.  Denote  by  b^, 

m 

bij  "  l  Pij(t)XjC(t)dt  * 

where  G(t)  is  the  d.f.  of  service  tine,  pi . (t)  is  the  probability 
that  a  pure  death  process  with  parameters  passes  from  state  i 
to  state  j  after  tine  t. 

The  bounds  on  q  are  based  on  the  following  lemma  which  has  an 
independent  interest  and  can  also  serve  to  compute  q. 


Lemma  (Sakhobov  8  Solovyev,  1977]. 


’  ■  cl.n/(cl,»  *  ••••  *  cn,n  *  »>  • 
where  c^  n  are  determined  from  the  following  recursive  relation: 

S.n  -  \n  *  jfk  Vi  ci.»  •  1  *  k  5  "  •  * 


(2.41) 


(2.42) 


Let  X  -  max  X.  ,  Xn  ■  min  X.  ,  y  •  X  /  exp(-X„t)G  (t)dt  . 
k  * ;  k  K  0  0 

A  simple  but  crude  version  of  a  two-sided  estimate  on  q  which  can  be 

derived  from  the  above  lemma  is  the  following  inequality:  if  2n_Xy  is  small, 

then 


bl,n  *  *  *  bi,nni^'1  • 


(2.43) 


Genis,  1978,  investigated  the  case  when  the  random  variable  c 
has  a  Laplace-Stiltjes  transform  E[e~^z]  close  to  1/(1  ■*■*): 


E[e"cz] 


2  3 

l+bjZ-^z  +bjZ 

5  I  ' 

l*z*a2z  -fa^z  +a^z 


z  ■  it  , 


where  ja^|  and  |b^|  are  ’'small". 

An  application  of  his  method  to  a  "two-period”  regenerating  process 
leads  to  the  following  estimate: 


sup|?{t/E[t]  s  x}  -l+e"x|  <  C'*8  , 
x 


where 

(i)  8  *  maxU.EtCxl.J^qCEC^x])51,  \  X2q(E[C2]), 

I-aV-CBCc3])^  ; 


(ii)  1/A  is  the  average  length  of  the  free  period;  c  is  the  length  of  the  busy- 

period;  x  is  the  indicator  of  SF  on  the  busy  period,  q  *  Ely]  ,  and  the 
free  period  has  an  exponential  d.f. 

(iii)  E[t]  ~  1/Aq  ; 

(iv)  0  <  C’  $  4  . 

An  interesting  and  quite  different  approach  to  measuring  the 


deviation  from  exponent iality  for  Markov  chains  based  on  the  notion  of  a 
complete  monotone  distribution  was  developed  by  Keilson,  1979. 
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Definition.  A  p.d.f.  f(x)  on  [0,»)  is  conqpletely  monotone  (write 
f  6  04)  if  all  derivatives  of  f  exist  and  (-l)nf^(x)  >0,  nil. 

It  turns  out  that  f  €  CM  f(x)  ■  /  ye_)rx  dG(x)  for  some 

0 

d.f.  G(x),  i.e. .  f(x)  is  a  mixture  of  exponential  densities  (see 
Keilson,  1979,  Section  S.3). 

The  following  quantity  8x  serves  as  a  distance  to  pure 
exponential ity  for  r.v.  X  with  p.d.f.  f(x)  €  CM: 

2 

0_  -  T*  -  1  .  (2.44) 

y 

where  y  ■  E[X]  and  ■  Var  X. 

0x  is  a  distance  in  metric  space  sense  for  f(x)  C  CM  that  have 
finite  second  moment  (Keilson,  1979,  Section  8.7).  This  makes  it 
possible  to  say  for  two  p.d.f. 's  f^  and  f 2  €  CM  which  of  them  is 
"more  exponential".  The  applicability  of  this  distance  measure  to 
reliability  problems  is  provided  by  the  fact  that  many  importnat  random 
variables  associated  with  a  Markov  process  have  a  p.d.f.  €  CM.  Consider 
a  time-reversible  ergodic  Markoc  chain  v(t)  (see  Keilson,  1979, 

Section  2. 4, and  note  that  every  ergodic  BD-process  is  time- reversible) . 
Decompose  the  state  space  of  v(t),  X,  into  the  set  of  "good" 
states  and  the  set  X^  of  "bad"  states.  Consider  the  passage  time 

from  *ome  i  6  Xj  to  set  Xj.  It  was  proved  that  p.d.f.  of  tig 
is  of  CM-type  (see  Keilson,  1979,  Section  8.9).  Thus  it  follows  that 
it  is  possible  to  apply  the  measure  of  exponential ity  (2.44)  to  r.v.'s 


X0B*  tEB*  tQB  "  t*ie  ex*t  t“ne  ^roa  ^be  bottom  state  0  €  to  the 
set  X2,  the  ergodic  exit  time  from  X^  and  the  quasi -stationary  exit 
time  to  X2  ,  respectively  (see  the  definitions  in  Section  2.6  )  .Of  course  for 
applications  one  needs  to  know  the  mean  value  and  variance  of  these  r.v.'s. 
Their  computation  might  be  rather  complex. Some  examples  of  these  computations 
are  given  in  the  above-cited  book  of  J.Keilson. 

It  would  be  desirable  also  to  express  the  deviation  from 
exponent iality  of  the  density  f(x)  €  CM  in  an  explicit  way.  The 
following  bound  was  found  by  Heyde  6  Leslie,  1974: 

Let  X  ■  Y*W,  Y  ~  Exp(l)  ,  and  W  a  nonnegative  r.v, ,  independent 
of  X  with  E[W]  -  1.  Then  for  all  x  >  0 

|P{X  >  x}  -  e~x|  *  Sir'1  G  2*(o*  -  1)*  (2.45) 

Remark.  Assume  that 

lim  P(qt/a  *  x}  »  1  -  e“x  ,  x  >  0  , 
q*0 

CO 

where  a  *  E[c]  *  /  (1-F(x))dx,  {  is  a  random  regeneration  period  and 

0 

t  is  the  time  of  the  first  appearance  of  a  "rare"  event  A  . 

Note  that  for  any  fixed  e  >  0  the  value  of  q*  such  that 
q<q‘*  IPtqt/a  »  x}-e~x|  <  e  depends,  generally,  on  the  form  of 
d.f.  F(x).  Moreover,  it  can  be  proved  that  for  any  fixed  q  >  0 
and  fixed  a,  no  upper  bound  for  P{t  <  x}  can  be  found,  except  for 
a  trivial  one.  More  precisely,  for  any  fixed  a>0,  T>0,  q>0  and 

CD 

e  >  0,  one  can  find  a  d.f.  H(x)  such  that  /  (1-H(x))dx  ■  a  but  at 

0 
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the  same  time,  P{t  (  T)  >  1-e.  Details  on  this  phenomenon  can  be  found 
in  the  paper  of  Kovalenko,  1973. 

3.  Kovalenko's  Theorem  on  Asymptotic  State  Enlargement 

A  special  random  process  transformation  termed  "state  enlargement" 
arises  in  situations  when,  one  is  dealing  with  a  multidimensional  process 
5(t)  *  Uj  (t),£2  (t))  which  has  the  following  property.  (t)  is  a 
slowly  varying  and  ggC*)  *s  a  "rapidly"  varying  component.  More 
specifically,  there  exists  a  time  interval  4  which  is  "small"  from 
the  viewpoint  of  g^(t)  and  "large"  from  the  viewpoint  of 
On  A,  the  process  (t)  can  be  investigated  for  a  fixed  value 
of  (t) ,  say  for  the  value  at  the  initial  time  in  this  interval , 
while  on  A  stability  is  acquired  by  a  certain  average  characteristic 
C j  (A 3  >  which  in  its  essential  features  determines  the  law  of  transition 
from  gj(t)  to  g^Ct+A).  Following  Kovalenko,  1977,  1980,  let  us 
consider  an  important  example. 

Let  ■  llp^H  be  the  transition  matrix  of  an  ergodic 

Markov  chain  { ^ }  and  let  {F^(x)J  be  a  set  of  distributions 
of  positive  r.v.'s.  Let  be  "small"  nonnegative  numbers  such 

that  £  e.C“’S)  $  1,  and  a, 8  are  members  of  some  finite  or 
8  13 

denumerable  set.  Let  us  construct  a  trajectory  of  a  two-dimensional 
SMP  (o(t),v(t)}  according  to  the  following  procedure. 
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1.  Select  a  pair  (a  ,v  )  as  the  initial  state  of  the  process 

n  n 

,{a(t),v(t)}  after  the  n**1  jump. 

2.  Select  state  of  the  second  component  according 

to  the  xule: 

CO 

MWJIV  *Pvn.j 

C°n)  CO 

3.  Select  one-step  sojourn  time  in  (a  ,v  ),  £  ~  F  (x), 


4.  Using  numbers  c 


Con,S) 

VVl 


n  n  v  ,v  ,  v  ,v  , 
n*  n+1  n'  n+1 


,  simulate  the  choice  of  a  new  state 


(o  .8) 

an+l:  an+l  *  °n  with  P»bability  1  -  I  t 

B/*a  n  n«-l 
n 


C«„.B) 


(i.e. ,  a  remains  unchanged);  with  probability  e  , 

n  vn'vnfl 

°n+l  “  »• 

CO 

5.  Remain  in  state  (a  ,v  )  for  the  time  £  and  move 

n  n  vn’Vl 

afterwards  to  the  state  (on+1 ,  vn+j) • 

One  can  see  that  a(t)  varies  "slowly"  and  v(t)  varies 
"rapidly".  Moreover,  there  is  a  small  probability  on  each  step  that 
a(t)  will  change.  Therefore,  one  could  expect  that  periods  of 
a(t)  *  Const  are  approximately  exponentially  distributed  (compare  with 
Keilson's  theorem).  It  turns  out  that  under  special  circumstances 
c(t)  indeed  behaves  as  a  continuous -time  Markov  chain.  More  precisely, 
if  a  series  of  conditions  related  to  the  properties  of  all  quantities 
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*  involved  in  the  description  of  {a(t),v(t)>  are  valid,  then  the 
following  theorem  is  true. 

Theorem  (Kovalenko,  1977) 

For  any  set  of  disjoint  time  intervals  A^  -  [a^,^] ,  i  ■  l,...,n, 
sup  iPiaCtj-a^tfiA^  i*l,n}  -  P{a*  (tj-c^.tCA^  i-l,n}|  0  , 

I  •  •  • 


where  a*(t)  is  a  separable  Markov  process  with  transition  rates 

J‘6  ’  l  • 

where  are  the  stationary  probabilities  for  Markov  chain  {v^®-'}, 

all  characteristics  of  random  processes  involved  depend  on  e,  and 
the  limit  is  taken  as  e  -*■  0.  # 


Thus,  one  can  see  that  asymptotically  the  first  component  of  a  two- 
dimensional  random  process,  a(t),  has  a  simple  structure  and  can  be  treated 
separately  from  v(t).  One  can  say  that  from  the  viewpoint  of  the  first  component, 
a(t) ,  the  states  of  the  second  component  v(t)  are  indistinguishable, which 
explains  the  term  "state  enlargement". 

More  formally, let  us  consider  some  partition  of  the  state  space  X  of 
x(tj  *{  a(t),v(t)}  into  the  sets  {  }  and  a  function  gCx(t)}  such  that 

*(£)  *  «(£}  if  x  €  Sg  and  y  €  S  and  g(x)  i  g(£)  if  x  €  S&  ,  y  e  S&  , 

t  &2  •  In  the  above,  example ,  g(o(t),v(t))  *  o*(t)  and  the  sets  * 

{  A  ;  v  ■  S*  Const. }  ,  where  A  is  the  state  space  of  a(t) . 

The  above-mentioned  papers  of  I.N. Kovalenko  contain  far  reaching  generalizations 
of  this  scheme  and  a  bibliography  of  other  works  related  to  this  topic. 
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4.  "Analyticostatistical11  Method  of  Computing  Reliability  Characteristics 

Let  us  discuss  very  briefly  an  example  illustrating  a  method  of 
computing  system  reliability  characteristics  described  by  Kovalenko,  1976. 

Assume,  a  Markov  chain  {vn»  n%0}  with  state  space  R  is  given  by 
an  initial  distribution  and  transition  probabilities,  both  of  which 
depend  on  a  small  parameter  e.  Specifically 


P{vQ-i} 


.(0) 


p'0)  (0) 


e.p‘0)a) 


*  e2-pf>(2) 


(4.1) 


MVi'J'Vu 


1J 


pf?^  ♦  e*p..(l)  ♦  e2*p..(2) 


(4.2) 


Let  A  c  R  be  a  failure  set,  and  suppose  it  is  important  to  estimate 
E[c],  the  average  value  of  r.v.  ?  defined  as 

C  «  f(vT)  ,  (4.3) 

where  f  is  some  given  function  and  t  *  inf{n:v  €  A}. 

n 

The  special  form  of  Markov  chain  characteristics  (4. 1,4. 2)  allows  to  obta 
a  representation  of  E[c]  in  series  form: 

Etc]  -  E[C0]  ♦  e-Et^]  ♦  e2-E[c2]  ♦  ...  (4.4) 

where  are  random  variables.  Their  distributions  depend  on  some  other 

auxiliary  random  variables  {0^}  whose  d.f. 's  involve  the  parameters 
of  the  series  (4. 1,4.2).  Thus,  it  is  possible  to  simulate  r.v.'s 
(9  }  and  by  means  of  them  to  obtain  relaizations  of  r.v.'s 

fll 
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CQ» Cj.Cj**"  •  Kovalenko's  idea  is  to  estimate  E[c]  by  c,  where 

t  *  C0  +  e*^  ♦  e*C2  +  »  (4*5) 

vThe 

and  to  obtain  i  i  0,  the  estimates  of  5^,  using  Monte-Carlo  simulation^  crucial 
point  is  that  due  to  the  specific  form  of  (4.1,4. 2),  only  a  few  terms 
in  (4.5)  should  be  estimated  in  order  to  achieve  good  precision. 

Many  additional  important  details  of  this  method  can  found  in  the 
above-cited  paper  of  Kovalenko  and  also  in  references  mentioned  there. 
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